CLAIMS 
What is claimed is: 

1 . A process for comparing two digital images, comprising: 
comparing texture moment data for the two images to provide a first 

similarity index; 

comparing color correlogram data for the two images to provide a second 
similarity index; 

comparing color moment data for the two images to provide a third 
similarity index; 

combining the first, second and third similarity indices to provide a 
similarity value; and 

determining that the two images match when the similarity value exceeds a 
first threshold value. 

2. The process of claim 1, wherein combining comprises forming a 
weighted sum fi-om the first, second and third similarity indices. 

3. The process of claim 1, further comprising determining that the two 
images do not match when the similarity value is less than a second threshold 
value. 

4. The process of claim 1, wherein the two images comprise a first and 
a second image, the first of the two images comprises a query image, and further 
comprising locating one or more matches to a plurality of images in a database of 
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images by iterating the acts of comparing color correlogram data, comparing color 
moment data, comparing texture moment data, combining and determining using 
as the second image a successive one image of the plurality of images. 

5. The process of claim 1, further comprising: 

comparing one or more high-level features from each of the two images; 

and 

adjusting the similarity value in accordance with comparing one or more 
high-level features, prior to determining. 

6. The process of claim 1, further comprising: 

extracting one or more high-level features from each of the two images, 
wherein the one or more high-level features include a high-level feature chosen 
from a group consisting of: presence/absence of one or more human faces, 
indoor/outdoor scene and time/date of image formation; 

comparing one or more of the high-level features from each of the two 
images; and 

adjusting the similarity value in accordance with comparing one or more 
high-level features, prior to determining. 

7. The process of claim 1, further comprising, after combining and 
before determining, adjusting the similarity value based on a calculation of 
commonality or lack of commonality between one or more high-level features 
associated with each of the two images and a confidence value thereof. 



36 



100603 J 141 MS1-162LPATJIPP 



8. The process of claim 1, wherein at least one of the two images is a 
digital image taken using a digital camera. 

9. The process of claim 1 , wherein combining comprises: 
weighting the first, second and third similarity indices by assigning the first 

similarity index a greatest weight and assigning the third similarity index a least 
weight; and 

adding the weighted first, second and third similarity indices to provide an 
adjusted similarity value, wherein determining employs the adjusted similarity 
value in determining that the two images match. 

10. The process of claim 1, further comprising quantizing the similarity 
value prior to determining, wherein quantizing comprises quantizing according to 
a tiered ranking scheme employing fewer than ten levels ranging firom a lowest to 
a highest tier, with greater similarity values corresponding to higher tiers, wherein 
the first threshold value corresponds to a highest tier into which similarity values 
are quantized. 

11. A process for manipulating image characterization data fi-om a 
digital image, comprising: 

indexing the digital image by extracting low-level feature data 
corresponding to a plurality of low-level features firom the digital image, the 
plurality comprising two or more low-level features chosen from a group 
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consisting of: texture moment data; color correlogram data; and color moment 
data; and 

organizing the data into a feature vector. 

12. The process of claim 1 1, wherein indexing comprises: 
first extracting texture moment data from the digital image; 
second extracting color correlogram data from the digital image; and 
third extracting color moment data from the digital image. 

13. The process of claim 11, further comprising storing the feature 
vector in a database. 

14. The process of claim 11, wherein organizing the data comprises 
forming a query vector, and further comprising: 

obtaining a feature vector from a group of feature vectors corresponding to 
a plurality of digital images; 

comparing the query vector to the feature vector to provide a similarity 

value; 

determining when the similarity value exceeds a first threshold; and 
iterating obtaining, comparing and determining for each feature vector of 
the group. 

15. The process of claim 11, wherein organizing the data comprises 
forming a query vector, and further comprising: 



lee hayesfk 6»ai442H 



38 



1006031141 MS1-1621.PATAPP 



comparing texture moment data for the query and feature vectors to provide 
a first similarity index; 

comparing color correlogram data for the query and feature vectors to 
provide a second similarity index; 

comparing color moment data for the query and feature vectors to provide a 
third similarity index; and 

combining the first, second and third similarity indices to provide the 
feature vector. 

16. A process for comparing two digital images, comprising: 
comparing texture moment data for the two images to provide a similarity 

index; 

combining the similarity index with other data to provide a similarity value; 

and 

determining a degree to which the two images match when the similarity 
value exceeds a first threshold value. 

17. The process of claim 16, wherein the similarity index is a first 
similarity index, and further comprising: 

comparing color correlogram data for the two images to provide a second 
similarity index; and 

comparing color moment data for the two images to provide a third 
similarity index; 
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wherein combining comprises combining the first, second and third 
similarity indices to provide the similarity value. 

18. The process of claim 16, wherein combining comprises forming a 
weighted sum from the similarity index and other data. 

19. The process of claim 16, further comprising determining that the two 
images do not match when the similarity value is less than a second threshold 
value. 

20. The process of claim 16, wherein the two images comprise a first 
and a second image, the first of the two images comprises a query image, and 
further comprising locating one or more matches to a plurality of images in a 
database of images by iterating the acts of comparing, combining and determining 
using as the second image a successive one image taken from the plurality of 
images. 

2 1 . The process of claim 1 6, further comprising: 

comparing one or more high-level features from each of the two images; 

and 

adjusting the similarity value in accordance with comparing one or more 
high-level features, prior to determining. 
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22. The process of claim 16, further comprising: 

extracting one or more high-level features from each of the two images, 
wherein the one or more high-level features include a high-level feature chosen 
from a group consisting of: presence/absence of one or more human faces, 
indoor/outdoor scene and time/date of image formation; 

comparing one or more high-level features from each of the two images; 

and 

adjusting the similarity value in accordance with comparing one or more 
high-level features, prior to determining. 

23. The process of claim 16, further comprising, after combining and 
before determining, adjusting the similarity value based on a calculation of 
commonality or lack of commonality between one or more high-level features 
associated with each of the two images and a confidence value thereof. 

24. The process of claim 16, wherein at least one of the two images is a 
digital image taken using a digital camera. 

25. The process of claim 16, wherein the similarity index is a first 
similarity index, and further comprising: 

comparing color correlogram data for the two images to provide a second 
similarity index; and 

comparing color moment data for the two images to provide a third 
similarity index; 
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wherein combining comprises: 

weighting the first, second and third similarity indices by assigning the first 
similarity index a greatest weight and assigning the third similarity index a least 
weight; and 

adding the weighted first, second and third similarity indices to provide an 
adjusted similarity value, wherein determining employs the adjusted similarity 
value in determining that the two images match when the similarity value exceeds 
the first threshold value. 

26. The process of claim 16, further comprising quantizing the similarity 
value according to a tiered ranking scheme employing fewer than ten levels 
ranging from a lowest to a highest tier, with greater similarity values 
corresponding to higher tiers, wherein the first threshold value corresponds to a 
highest tier into which similarity values are quantized. 

27. A camera comprising: 

an image capture device configured to capture digital images; 

a memory coupled to the image capture device and configured to store a 
database of image data, including the digital images and associated feature vectors 
each comprising texture moment data, correlogram data and color moment data; 
and 

an image similarity module coupled to the memory and configured to: 
generate a query vector comprising texture moment data; 
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compare, in succession, the query vector to each feature vector in the 
database, to generate a similarity value; 

classify each feature vector to assign each feature vector to a tier in a 
tiered similarity structure based on the associated similarity value; and 

group images associated with the respective feature vectors in each 
tier of the similarity structure. 

28. The camera of claim 27, wherein the image similarity module is 
further configured to: 

adjust each similarity value in conformance with comparison of high-level 
data corresponding to the query vector and high-level data corresponding to each 
feature vector to provide an adjusted similarity value corresponding to each feature 
vector; and 

use the adjusted similarity value to classify each feature vector in the tiered 
similarity structure. 

29. The camera of claim 27, wherein the image similarity module is 
further configured to adjust each similarity value in conformance with comparison 
of high-level data corresponding to the query vector and high-level data 
corresponding to each feature vector to provide an adjusted similarity value 
corresponding to each feature vector, wherein high-level data comprises: 
presence/absence of one or more human faces; indoor/outdoor scene; and time of 
image formation. 
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30. The camera of claim 27, wherein the image similarity module is 
further configured to: 

adjust each similarity value in conformance with comparison of high-level 
data corresponding to the query vector and high-level data corresponding to each 
feature vector to provide an adjusted similarity value corresponding to each feature 
vector, wherein high-level data comprises: presence/absence of one or more 
human faces, indoor/outdoor scene and time/date of image formation; and 

use the adjusted similarity value to classify each feature vector in the tiered 
similarity structure. 

31. The camera of claim 27, further comprising a monitor configured to 
facilitate viewing of digital images stored in the database, wherein the digital 
images are accessed via associated feature vectors selected within a tier of the 
tiered similarity structure. 

32. The camera of claim 27, wherein the query vector further comprises 
correlogram data and color moment data. 

33. A computer readable medium having a plurality of instructions 
thereon that, when executed by one or more processors, cause the one or more 

processors to: 

successively compare a query vector to each feature vector in a database, 
the query vector and the feature vectors each including texture moment data; and 
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rank each feature vector into a tier of a tiered classification scheme based 
on the comparison between the feature vector and the query vector. 

34. The computer readable medium of claim 33, wherein the plurality of 
instructions that cause the one or more processors to successively compare further 
comprise instructions that cause the one or more processors to: 

successively compare texture moment data from the query vector to texture 
moment data from each feature vector to provide a first similarity index; 

successively compare color moment data from the query vector to texture 
moment data from each feature vector to provide a second similarity index; and 

form a similarity value as a weighted sum of the first and second similarity 
indices, wherein the plurality of instructions that cause the one or more processors 
to rank comprise instructions that cause the one or more processors to quantize 
similarity values into ranked tiers based in part on high-level features associated 
with the query vector and the feature vectors, each tier corresponding to a different 
degree of similarity between the query vector and the feature vectors associated 
with that tier. 

35. The computer readable medium of claim 33, wherein the plurality of 
instructions that cause the one or more processors to successively compare further 
comprise instructions that cause the one or more processors to: 

successively compare texture moment data from the query vector to texture 
moment data from each feature vector to provide a first similarity index; 
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successively compare correlogram data from the query vector to texture 
moment data from each feature vector to provide a second similarity index; 

successively compare color moment data from the query vector to texture 
moment data from each feature vector to provide a third similarity index; and 

form a similarity value as a weighted sum of the first, second and third 
similarity indices for each feature vector, wherein the plurality of instructions that 
cause the one or more processors to rank comprise instructions that cause the one 
or more processors to quantize similarity values into ranked tiers based in part on 
high-level features associated with the query vector and the feature vectors, each 
tier corresponding to a different degree of similarity between the query vector and 
the feature vectors associated with that tier. 

36. The computer readable medium of claim 33, wherein the plurality of 
instructions that cause the one or more processors to rank comprise instructions 
that cause the one or more processors to quantize similarity values into ranked tiers 
based in part on high-level features associated with the query vector and the 
feature vectors, each tier corresponding to a different degree of similarity between 
the query vector and the feature vectors associated with that tier. 

37. A system for image correlation comprising: 
one or more processors; 

a memory coupled to the one or more processors and configured to store a 
database representing digital images; and 
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an image comparison module configured to cause the one or more 
processors to access the data representing the images and to select one or more 
feature vectors each associated with a corresponding image based on comparison 
of color texture data and other data contained in each feature vector with 
analogous data contained in a query feature vector. 

38. The system of claim 37, wherein the image comparison module 
further is configured to cause the one or more processors to: 

compare correlogram data and color moment data contained in each feature 
vector with analogous data contained in the query feature vector; and 

select the one or more feature vectors based on a weighted sum of similarity 
indices respectively derived from comparing the color texture moments, the 
correlogram data and the color moment data. 

39. The system of claim 37, wherein the other data include high-level 
feature data. 

40. The system of claim 37, wherein the image comparison module 
further is configured to cause the one or more processors to: 

extract one or more high-level features contained in each feature vector and 
analogous data contained in the query feature vector, wherein the one or more 
high-level features include a high-level feature chosen from a group consisting of: 
presence/absence of one or more human faces; indoor/outdoor scene; and time of 
image formation; 
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compare one or more of the high-level features from each feature vector 
and analogous data contained in the query feature vector; and 

employ results from comparing the one or more high-level features in 
selecting the one or more feature vectors. 

41. The system of claim 37, further comprising a display device coupled 
to the one or more processors and to the memory and configured to display digital 
images corresponding to the selected one or more feature vectors in response to 
user input. 
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